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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed 9/25/2007 with respect to claims 20 & 21 rejected 
under 35 USC 101 have been fully considered and are persuasive. The rejection of 
these claims has been withdrawn. 

2. Applicant's arguments filed 9/25/2007 with respect to claims 1-3, 5-22 rejected 
under 35 USC 102 and 103 have been fully considered but they are not persuasive. 

The Applicant argues that Berstis fails to teach or suggest "a display configured 
to display each frame using the orientation information, such that the displayed frame is 
oriented the same as an orientation of the image capture system when the frame was 
captured." as recited in claim 1. 

In response, the Examiner understands the Applicant's arguments but 
respectfully disagrees. It is clearly seen in Berstis that the orientation of each video 
frame is recorded as shown in step 78 of Fig. 4 and this orientation of each video frame 
is used to reproduce the correct orientation of the video frame when the frame is 
reproduced for the virtual reality as the user entering the virtual building at point A 
shown in Figs. 5 & 7. Berstis discloses in col. 6, lines 2-12 and col. 7, line 66 - col. 8, 
line 40 that the system comprises a display (18 in Fig. 1) for displaying each frame in 
the same orientation as it was captured to create a virtual 3-D. video along the paths A, 
B, C, D and so on. 
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For the independent claims 5, 11 , 17, 20, 21 , the Applicant argues for the similar 
feature as recited in claim 1.. These claims are also met by the analysis of claim 1 . It is 
noted that the Applicant does not argue for claim 22. 

In view of the above, the Applicant's claimed invention is written broad enough to 
read on the teaching of Berstis, and thus the rejection is maintained. 

Specification 

3. The amendments to the specification filed 9/25/2007 are accepted. 

Claim Rejections - 35 USC § 101 

4. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claim 22 is rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. Claim 22 merely lists data structure of a video 
clip representing descriptive material perse and is not directed to a practical 
application. The claim does not require any physical transformation and the invention 
as claimed does not produce a concrete, useful and tangible result, and hence non- 
statutory. 



Claim Rejections - 35 USC § 102 
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The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale In this country, more than one year prior to the date of application for patent in the United 

States. 

5. Claims 1, 5-6, 8-12, 14-18. 20-22 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Berstis (US 6,337,688). 

Regarding claim 1 , Berstis discloses a video system (Figs. 1 & 2) comprising: 

an image capture system (video camera 12) configured to capture a plurality of 
frames of a video clip (col. 3, lines 1-10 and col. 5, lines 45-63); 

a sequence data generating system (Figs. 2 & 4) for generating data indicative of 
frame position of each of the plurality of frames (see col. 3, lines 42-63 and col. 5, lines 
48-63, wherein frame position of each of the video frames is indicated by the position of 
the camera sensed by the position and orientation sensor 34, or the frame position 
reads on the frame number); 

an orientation sensor (34) configured to provide orientation information for each 
of the plurality of frames at the time each frame Is captured (Figs. 2 & 4; col. 3, lines 49- 
63); 

a processor (30) configured to incorporate the orientation information and 
sequence data into each frame (Figs. 2 & 4; col. 5, lines 48,-53), a display (18 in Fig. 1) 
configured to display each frame using the orientation information, such that the 
displayed frame is oriented the same as an orientation of the image capture system 
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when the frame was captured (see Figs. 5 & 7; col. 6, lines 2-12 and col. 7, line 66 - 
col. 8, line 40, and note that each frame is displayed in the same orientation as it was 
captured to create a virtual 3-D video along the paths A, B, C, D and so on. Please see 
the Examiner's response section 2 above). 

Regarding claim 5, this method claim is also met by the analysis of apparatus 

claim 1 . 

Regarding claim 6, it is also clear in Berstis that the steps of claim 6 are repeated 
to capture a plurality of serially sequenced frames corresponding to the video clip (see 
col. 5, line 45 -col. 6, line 12). 

Regarding claim 8. Berstis further discloses that the step of incorporating the 
orientation information comprises incorporating the orientation information into the 
frame as a file (col. 5, lines 48-60). 

Regarding claim 9, Berstis further discloses that the step of incorporating the 
orientation information comprises incorporating the orientation information into the 
image data (col. 5, lines 53-57). 



* 
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Regarding claim 10, as clearly disclosed In Figs. 2 & 4 and col. 5, lines 48-53, a 
step of saving the frame into a memory (32) comprising a plurality of serially sequenced 
frames corresponding to the video clip. 

Regarding claim 1 1 , Berstis discloses a method for displaying a frame of a video 
clip (Fig. 8), the method comprising the steps of: 

receiving the frame having at least image data and sequence data corresponding 
to an image captured by an Image capture device (col. 7, line 66 - col. 8, line 40); 

receiving orientation information residing in the frame; determining an orientation 
of the frame, the orientation of the frame corresponding to the orientation of the image 
capture device at the time the image was captured; and displaying the frame oriented in 
accordance with the determined orientation (col. 7, line 66 - col. 8, line 40, wherein the 
captured frames are displayed in the same orientation as they were captured when the 
user inputs a command to view virtual 3-D video from point A to point L of the interior of 
a building as illustrated in Fig. 5). 

Regarding claim 12, as the user selects point B shown in Fig. 5, a frame from a 
plurality of serially sequenced frames corresponding to the video clip at point B is 
selected for displaying (col. 8, lines 30-40). 

Regarding claim 14, it is clearly seen in col. 7, line 66 - col. 8, line 40 that the 
frame is retrieved from a memory (32) to generate the virtual 3-D video. 
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Regarding claim 15, Berstis further discloses the steps of: communicating the 
frame from an image capture device (video camera 12) to a processing device 
(computer 6 shown in Fig. 1); and displaying the frame on a display (18) coupled to the 
processing device (col. 2, lines 50-67). 

Regarding claim 16, see the analysis of claim 15 in which display 18 is coupled 
to the camera via communication line 8 (Fig, 1). Furthermore, the frame can be 
displayed (not necessarily to be displayed in the same orientation as it was captured) on 
the LCD attached to the camera (col. 4, lines 1-5). 

Regarding claim 17, Berstis discloses a system for providing orientation 
information for frames of a video clip (Fig. 1), comprising: 

means (optical input/image sensor 42) for capturing an image (Fig. 2; col. 3, lines 

1-10); 

means (combined 42 and 30) for generating a frame having at least image data 
corresponding to the captured image and sequence data (i.e., frame number), wherein 
the frame is one of a plurality of serially sequenced frames corresponding to the video 
clip (Figs. 2 & 4 and col. 5, lines 45-63); 

means (34) for sensing an orientation of an image capture device at the time the 
image is captured (col. 3, lines 49-63); 

means (30) for incorporating the orientation into the frame (col. 5, lines 45-63); 
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means (32) for storing the frame with the orientation in a memory (col. 5, lines 
45-57); 

means (18) for displaying the frame oriented in accordance with the sensed 
orientation (col. 6, lines 2-12 and col. 7, line 66 - col. 8, line 40, wherein the frame is 
displayed in the same orientation as it was captured when it is reproduced to create a 
virtual reality as discussed in the Examiner's response in section 2 above). 

Regarding claim 18, also disclosed by Berstis is a means for generating 
orientation information from the orientation of the image capture device such that the 
orientation information is incorporated into the frame (col. 5, lines 45-57). 

Regarding claims 20 & 21 , these program claims are also met by the analyses of 
method claims 11, 14, 5 and 6 realized by a program stored in a computer-readable 
medium (i.e., CD-ROM, hard disk, etc. ). See col. 9, lines 54-60. 

Regarding claim 22, Berstis discloses a video clip (col. 3, lines 1-10) comprising: 
a first frame comprising image data, video sequence data (i.e., frame number) 
and image orientation data (col. 5, lines 45-63); and a second frame (another frame in 
the video sequence) comprising second image data, second video sequence data (i.e., 
a subsequent frame number) and second image orientation data (col. 5, lines 45-63), 
the second frame serially sequenced immediately behind the first frame (this is inherent 
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as sequence of video frames captured by the video camera 12 in time sequence as 
disclosed in col. 3, lines 1-10). 

Claim Rejections - 35 (JSC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill In the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 2, 3, 7, 13& 19 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Berstis (US 6,337,688) in view of Parulski et al. (US 5,900,909). 

Regarding claim 2, although Berstis teaches that the orientation information is 
incorporated with each image frame (col. 5, lines 48-57), Berstis is silent about that the 
orientation information resides in a frame header of each frame. However, as taught by 
Parulski, It is well known in the art that the orientation code of an image is stored in the 
frame header of an image so that the image orientation is quickly detected during 
playback for rotating the displayed image to the same orientation as it was captured 
(see Parulski, Fig. 6 and col. 5, lines 40-56). 

Therefore, it would have been obvious to one of ordinary skill in the art to 
configure the video system of Berstis to store the orientation information in a frame 
header of each frame so that the orientation information would be quickly retrieved 
during playback. 
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Regarding claim 3, it is also seen in the combined teaching of Berstis and 
Parulski that a memory is configured to receive each frame wherein the orientation 
information resides (see Berstis, col. 5, lines 48-57 and the analysis of claim 2). 

Regarding claims 7, 13 & 19, these claims are also met by the analyses of claims 
2 & 3 above. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nhan T. Iran whose telephone number Is (571) 272- 
7371 . The examiner can normally be reached on Monday - Friday, 8:00am - 4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Patent Examiner 



